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Introduction 



Rational Software provides a software development platform that improves the speed, quality, and predictability of software 
projects. This integrated, full life-cycle solution combines software engineering best practices, market-leading tools, and 
professional services. HP OpenView Storage Mirroring provides real-time enterprise data protection and replication. HP 
OpenView Storage Mirroring can be used to provide high availability for your Rational server. 

This document describes the steps necessary to configure HP OpenView Storage Mirroring to provide high availability for 
Windows 2000 servers running the ClearCase, ClearQuest, and/or RequisitePro components of the Rational Software Suite. 
These procedures allow a secondary server to assume the identity and role of a failed Rational server. To complete these 
instructions, you will install Rational and HP OpenView Storage Mirroring, and configure HP OpenView Storage Mirroring 
for replication and failover. Due to the complexities of these applications, this document is intended for network administrators 
with experience installing, configuring, and maintaining network applications including HP OpenView Storage Mirroring and 
Rational. 



Requirements 

Due to the complexities of these instructions, this document is intended for network administrators with experience installing, 
configuring, and maintaining network applications, including HP OpenView Storage Mirroring, Rational, and Microsoft SQL 
Server. 

♦ Two licensed copies of Microsoft Windows 2000 with the latest service pack 

♦ Two licensed copies of each Rational component (ClearCase, ClearQuest, and/or RequisitePro) 

♦ The source and target must located in the same domain to maintain file security and ownership. 

♦ Two licensed copies of HP OpenView Storage Mirroring 4.x 

♦ The HP OpenView Storage Mirroring Chngname utility 



NOTE: The Chngname.exe utility is available from 

http://h20000.www2. hp. com/bizsupport/TechSupport/DriverDownload.jsp?pnameOID=41 5 
609&locale=en US&taskld=135&prodSeriesld=359583&prodTypeld=12169&swEnvOID= 
181#2671 
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Protecting Your Rational Data 

In this section, you will be 

1 Installing and Configuring ClearCase, ClearQuest, and/or RequisitePro 
2. Installing HP Open View Storage Mirroring 

Configuring HP Open View Storage Mirroring for mirroring and replication 
4. Configuring HP Open View Storage Mirroring for failover 
1. Install and configure the Rational Tools. 

a. Install ClearCase, ClearQuest, and/or RequisitePro on the source, if they are not already installed. 
Record the drive and directory where your critical Rational files are located. 



Product 


Component 


Default Location 


Your Location 


ClearCase 


VOB directories a b 








Registry 


cc mstallYvanrgy 






License 


cc install\common\rational*.dat 






View server 0 






ClearQuest 


Schema and user 
databases d 


db installMog 
db_install\data e 




RequisitePro 


Test Data Store 
Project Paths f 


rq_install 





a. Include both the main VOB server and any secondary VOB servers. 

b. A list of VOB directories can be obtained from the cleartool lsvob command. 

c. A list of the VOB storage space can be obtained from the cleartool lsview -host <server> command. 

d. If you are using Microsoft SQL Server, use the Enterprise Manager, Database Properties to determine the location of 
the database files. 

e. By default, Microsoft SQL Server stores files in the \log and \data directories. If you are using a different database, 
select the appropriate directories for your application. 

f. Use the RequisitePro Rational Administrator to determine the location of these files. 

c. Install the same applications (ClearCase, ClearQuest, and/or RequisitePro) on the target making sure that you specify 
the same file locations that you recorded in the previous table. 



NOTE: You do not need to install any ClearCase VOBs or view storage locations on the target. 
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On the target, set the following ClearCase services to manual startup so that all of the files are closed on the target. 
This allows the changes from the HP Open View Storage Mirroring source to be written to disk on the target as soon 
as they are received. 

♦ Atria Location Broker 

♦ Atria Lock Manager 

♦ Atria Cred Manager 

NOTE: If a failure should occur, the failover script that you will be creating will automatically start the Rational 
services on the target. 

The Atria Location Broker service on the target must be started using the same network account that is 
used on the source. 

e. On the target, set the ClearQuest and RequisitePro services to manual startup so that all of the files are closed on the 
target. The services will depend on the database application you are using. For example, if you are using Microsoft 
SQL Server, you would set the following services to manual startup. 

♦ Distributed Transaction Coordinator 

♦ MS SQL Server 

♦ SQL Server Agent 

Depending on your environment and your application, there may be additional services to consider beyond just the 
application basics. For example, Message Queuing is an optional service for Microsoft SQL Server. Check your 
database documentation to determine the names of the services used by your database application. 

NOTE: If a failure should occur, the failover script that you will be creating will automatically start the Rational 
services on the target. 

f. Configure ClearCase on the target. 

1. Create the user clearcasealbd on the target server, if the target is in a different domain. 

Verify that the permissions assigned to the clearcase albd user grants full control to the following: 

C: (or the volume where ClearCase is installed) 

C:\WINNT (or the location where Windows is installed) 

C:\WINNT\system32 (or the location where Windows is installed) 
d. The ClearCase installation directory and all of its subdirectories 

The default temporary directory (c:\documents and settings\administrator\local settings\temp) 

Server storage directory for each VOB (*.vbs) 
g. VOB sever storage share (ccstg c or parent directory of *.vbs) 

Verify that the permissions assigned to the VOB domain groups grants read, write, and execute control to the 
following: 

Server storage directory for each VOB (*.vbs) 
b. VOB sever storage share (ccstg c or parent directory of *.vbs) 
Configure ClearQuest on the target. 

Create the ClearQuest administrator login on the target server, if it does not already exist. 

2. Verify that the ClearQuest administrator is granted permissions to cqschema and all user databases with the roles 
as public and db owner. 

2 Install HP Open View Storage Mirroring on both the source and target using the installation defaults. 

Configure HP OpenView Storage Mirroring for mirroring and replication. 

Right-click your source machine and select New, Replication Set and enter the desired name for the replication set. 

b. Select the critical Rational data that needs to be available on the target if the source fails. This includes all of the file 
locations that you specified in step 2 earlier. (It is not necessary to replicate the application files since they are already 
exist on the target machine.) 

Right-click the replication set name and select Save to save the replication set. 
d. Drag and drop the replication set onto the target. The Connection Manager dialog box opens. 
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The Source Server, Target Server, Replication Set, and Route fields will automatically be populated. If you have 
multiple IP addresses on your target, verify the Route field is set to the correct network path. (For detailed information 
on connecting a source and target, reference the HP OpenView Storage Mirroring User's Guide.) 

Select the One To One mapping so that the replication set data is transmitted to the same directory structure on the 
target. 

g. Click Connect to start the mirror and replication processes. 



NOTE: At this point, you have actually established a Rational disaster recovery configuration. (Disaster recovery 
in this context means that the data is located on a target machine. This may not meet the policy requirements 
of your organization.) This disaster recovery model can be extended to provide enhancements to your 
backup process. Because Rational recommends locking the ClearCase VOBs so that the last database 
checkpoint will be written to disk, you can perform this lock and subsequent backup on your HP OpenView 
Storage Mirroring target thus eliminating downtime on the source and to your end users. 



After the initial mirror is complete, the target machine will have the same Rational data as the source. Replication will 
keep the two machines synchronized. 

Configure HP OpenView Storage Mirroring failover and failure monitoring 

If a failure occurs, you will want to have the Rational services start on the target machine automatically. To do this, 
create a batch file called postover . bat using the following sample batch file. Save the batch file to the same 
directory where your HP OpenView Storage Mirroring files are installed. 

POSTOVER.BAT 



rem This command temporarily changes the name of the server. The Chngname utility should be downloaded and 
rem placed in the same directory where HP OpenView Storage Mirroring is installed. Replace 
<drive> : \<directory>\ in the command 

rem below with that location and replace source_name with the name of the source machine. 
<drive>\<directory>\chngname /s source_name 

rem If you are using ClearCase, use the following commands to start the ClearCase services, 
net start "Atria Location Broker" 
net start "Atria Lock Manager" 
net start "Atria Cred Manager" 

rem If you are using ClearQuest, start your database services. The following example commands startp a SQL 
re, database. Substitue the appropriate service names based on the database application you are using, 
net start "Distributed Transaction Coordinator" 
net start "MSSQLServer" 
net start "SQLServerAgent" 

rem After starting the required services, change the name of the server back to its original target name, 
rem Substitute the location of the Chngname utility for <drive>: \<directory>\ 
<drive>\<directory>\chngname /t 



NOTE: If you have a separate database application for RequisitePro, you will have to add those services to the 
postover . bat script as well as the next one. 



After a failure is resolved, you can bring your source back online. If you do this, you will want to stop the Rational 
services on the target automatically. To do that, create a batch file called preback . bat using the sample batch file 
below. Save the batch file to the same directory where your HP OpenView Storage Mirroring files are installed. 

PREBACK.BAT 



rem If you are using ClearCase, use the following commands to stop the ClearCase services, 
net stop "Atria Location Broker" 
net stop "Atria Lock Manager" 
net stop "Atria Cred Manager" 

rem If you are using ClearQuest, stop your database services. The following example commands startp a SQL 
re, database. Substitue the appropriate service names based on the database application you are using, 
net stop "Distributed Transaction Coordinator" 
net stop "MSSQLServer" 
net stop "SQLServerAgent" 
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Open the Failover Control Center (Start, Programs, HP Open View Storage Mirroring, Failover Control Center). 

d. Select the target machine from the list of available machines. If the target you need is not displayed, click Add Target, 
enter the machine name, and click OK. 

Click Login to login to the target machine. 

f. To add a monitor for the selected target, click Add Monitor. Type the name of the source machine and click OK. The 
Monitor Settings window will open. 

g. In the Monitor Settings window, mark the IP address that is going to failover. 



Monitor Settings - JERSEY 



Names to Monitor: 



1 0 IP 10.0.21.78 

HEP 109.254.150.31 



Target Adapter: 

| [3] 3Com EtherLink XL 1 0/1 00 PCI For Complete PC Management NIC (3C< 

.. -. . . . [7 — "TT Current IP Address(es): 
Monitor Interval: 

Missed Packets: 
Failover Trigger- 



r 



10.0.21.99 



( 0 IP Placeholders ] 



All Monitored IP Addresses Fail 
("One Monitored IP Address Fails 



Failover Method — 

(* Add Source Identity to Target 

(~ Replace Target Identity with Source 



Items to Failover — 
W IPAddress(es) 

(~ Monitored 

(* All 
W 9erver Name 



W 9hare(s) 



W Manual Intervention 

W Use .SHR Share Mapping File (If 
Available) 




-Active Directory: — 
V Failover Hostname 
\~ Failback Hostname 



OK 



Cancel 



Click Scripts and specify the scripts that were created earlier. 
Click OK to go back to the Monitor Settings dialog box. 
j. If you are using Active Directory, complete the following steps. 

1. Enable Failover Hostname so that the host SPN is removed from Active Directory on the source and is added to 
the target. 

2. Enable Failback Hostname so that the SPN is returned to the original settings on both the source and target during 
failback. 

3. Click Account and identify a user and the associated password that has update privileges within Active Directory. 
This allows SPNs to be created and deleted during failover and failback. Click OK to return to the Monitor 
Settings dialog box. 

Click OK to begin monitoring the source machine. 

In the event of a source machine failure, your target machine is now ready to stand in for your source. For details on monitoring 
failover, see the HP Open View Storage Mirroring User 's Guide. 
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After a Source Failure 



As long as HP Open View Storage Mirroring is replicating, if the source machine fails, the target machine contains the latest 
Rational data. If a failure occurs, failover will start the services on your target and your pre-configured Rational tools will be 
available to the users from the target. Users may need to restart their client applications to establish a connection to the target, 
standing in for the source. 

Although no modifications are required, Rational recommends running the ClearCase command checkvob when the VOBs are 
brought down without using their documented procedures. Checkvob confirms that any source modification is recorded in its 
underlying database. If there are an inconsistencies between a modification and its entry in ClearCase's underlying database, 
checkvob corrects it. If a modification was saved just before the ClearCase server failed and the entry is not in the ClearCase 
database, checkvob indicates the problem and ask for permission to remove the modification. Use the following command to 
verify the consistency of the data. 

cleartool checkvob -pools -fix [-force -ignore] <global vob path> 

At this time, it is possible to designate the target as your new source. If you do that, you will not need to restore anything back 
to your original source. You can locate a new target and repeating the configuration steps, use the new pair of machines to 
protect your Rational data. But if you prefer to revert back so that your source is running on its original machine, you can 
continue with the next section. 



Reverting Back to the Original Configuration 

It is possible to skip this section by designating the target as your source and using another machine as the new target, but if you 
prefer to revert back to your original source machine, use these instructions. 

Verify that your original source machine is not connected to the network. If it is, disconnect it. 

Resolve the source machine problem that caused the failure. 



NOTE: If you must rebuild your hard drive, continue with step 3. If you do not need to rebuild your hard drive, 
continue with step 6 below. 



3. Install Windows. Since your source machine is not connected to the network, go ahead and use the source's original name 
and IP address. 

4. Install HP Open View Storage Mirroring using the installation defaults. 

Install Rational using the same file locations recorded in step 2 under Protecting Your Rational Data on page 2. 

6. Verify that Rational is not running on the source. The Rational services must not be running at this time so that you can 
restore the updated data on the target back to the source. Depending on the type of failure, your services may still be 
running. Stop your Rational services. 

Select Start, Programs, HP Open View Storage Mirroring, Failover Control Center. 
Select the target machine that is currently standing in for the failed source. 
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9. Select the failed source and click Fallback. 



!-r Failover Control Center 


-ln| x| 


File Monitor Settings Help 
Target Machine: 


[jersey 


Add Target... 


Monitored Machines/Names: 




□-•Jl INDY 

• IP 169 254 150 31 " Failed Over " 
1 • IP 10.0.21.78" Failed Over" 


Login 




Add Monitor... j 


Remove Monitor 






Edit Monitor... 






Update Shares 






Failover 


Failback 








I 





The pre-failback script entered during the failover configuration stops the Rational services on the target so that no 
additional changes can be made. 

10. You will be prompted to determine if you want to continue monitoring the source server. Do not choose Continue or Stop 
at this time. 

11. Connect the source machine to the network. 

12. Open the HP Open View Storage Mirroring Management Console (Start, Programs, HP Open View Storage Mirroring, 
Management Console), highlight the source machine, and ensure that the Rational replication set is not connected so that 
replication does not continue after failback is complete. If the replication set is connected, disconnect it by right-clicking 
it and selecting Disconnect. 

13. After the source is back online, select whether or not you want to continue monitoring this source machine. 

To begin the restoration process, open the HP Open View Storage Mirroring Management Console and select Tools, 
Restoration Manager. 



NOTE: You can also run the HP Open View Storage Mirroring DTCL automated restoration script, which can be 
found in HP Open View Storage Mirroring's User's Guide, to complete the remaining steps in this section. 

Complete the appropriate fields as described below. 

♦ Original Source — The name of the source machine where the data original resided. 

♦ Restore From — The name of the target machine that contains the replicated data. 

♦ Replication Set — The name of the replication set to be restored. 

♦ Restore To — The name of the machine where the data will be restored. This may or may not be the same as the original 
source machine. 

16. Identify the correct drive mappings for the data and any other restoration options necessary. For detailed information on 
the restoration options, see the HP OpenView Storage Mirroring User s Guide. 

17. Verify that the selections you have made are correct and click Restore. The restoration procedure time will vary depending 
on the amount of data that you have to restore. During the restoration, users will be unable to access Rational. 

18. After the restoration is complete, start the Rational services on the source machine. 

19. Reestablish the HP OpenView Storage Mirroring Rational replication set connection. 

At this time, your data is restored back to your source machine, the source machine is again the primary Rational server, and, 
if you selected to continue failover monitoring, the target is available to stand in for the source in the event of a failure. 



7of 7 



